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This paper details how memory protocols obtained in 
individual interviews may be translated to scores on several 
dimensions suggested by White. White's nine dimensions are: (1) 
extent, (2) precision, (3) internal consistency, (4) accord with 
reality, (5) variety of types^df element, (6) variety of topics, (7) 
shape, (8) ratio of internal to external associations, and (9) 
availability. Following a description of how the interviews of 23 
science graduates, ages 20 to 27,. enrolled in the Diploma of 
Education program at Monash University, were conducted, the process 
of translation is described, difficulties are identified, and options 
discussed. The next section considers the results, in which 
consistent traits of individuals are identified. The following 
section discusses the level of knowledge displayed by the people 
interviewed, and comments on implications this has for education. 
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CONVERTING MEMORY PROWLS TO SCORES ON SEVERAL DIMENSIONS 

Richard T. White & Richard F. Gunstone 
Monash University 

Cognitive structure is an important but nebulous construct in the 
theory and practice of Earning. «bite .1979, argued that to achieve 
cl.fity in its definition one must specif, a number of dimensions, and 
nested a set of nine to initiate discussion. «hUe also considered how 
S everal existing methods of investigating cognitive structure illuminate 
these dimensions, but bis discussion remained general and did not e.t to 
aetails of bo„ the information obtained by any of tbese tecbnigues could be 
translated to scores on any o, tbe dimensions. *» present paper details 
how memory protocols obtained in individual interviews may be translated to 
scores on several of White's dimensions, allowing a description of how 
the interviews were conducted, the first substantive section describes the 
'process of transition and identifies difficulties and discusses options. 
The second section considers the results, in which consistent traits of 
individuals are identified. The third section discusses the level of 
Knowledge displayed by the people interviewed, and comments on implications 
this has for education. 
Conduct of interviews 

The two authors shared'the interviewing task. In total they saw 
28 science graduates, of ages 2 0 to 27, who were enrolled in the Diploma 
of Education program at «onash University. Each respondent was asked about 
two topics, first electric current and then, immediate!, following, 
eucalypts. These topics were chosen because they were thought to be 
subjects on which the graduates would be moderately well-informed, and 

The lack of relation was necessary because 
because they were unrelated. The iac« or 

u i-K^r 4-hpre were consistencies across 
one purpose of the study was to see vhether there 

— topics in individual^ standin g s_on. m any_of these d i^naions^ _ 



The lengths of the interviews depended on how much the respondents 

knew. For the two topics combined .they ranged from 25 minutes tp 75 
minutes. 

Each respondent was told that the pur; ose of the study -was to see 
how people arranged knowledge in memory, and that they would be asked to 
tell all they knew about two topics. They were asked if they minded the 
interview being recorded, and were assured that the recordings would be 
anonymous. 

They were first asked, "What can you tell me about electric 
current?" This question prompted from 3 to 20 statements. When the 
respondent indicated that nothing more was coming to mind, the interviewer 
asked "Do you have any personal experiences relating to electric current?" 
and then, later, "Do you have any mental pictures relating to electric 
current?" These three questions were designed to elicit three types of 
element in cognitive structure, which Gagne and White (1978) called 
propositions, episodes, and images. Next, the same three questions were 
asked about resistance, potential difference. Ohm's Law, charge, 
insulators, batteries, AC, and DC, which were chosen as important concepts 
in 'electricity. The interview then became more specific. The respondents 
were asked what they knew about formulae and definitions involving electric 
current, things they saw_as similar or analogous to electric current, 
properties of electric current, its production, its uses and effects, its 
measurement, types of electric current,, the history of electric current, 
and whether they recalled any incidents in films or books in which electric 
current played a major part. Finally they were asked whether anything else 
about electric current had occurred to them. Mucfl^the same procedure was; 
then followed for eucalypts. 



set of distinct propositions, images, and episodes. 
^. w ,i,Mon of P r— 1« to Scores on Dimensions 

White's (1979) nine dimensions are: 
1. Extent, hpw much the person knows of a topic. 

2 Precision, how clear and complete each element of memory is. ^ 
3'. Xnternal consistency, whether there are contradictions in the person's 

knowledge. 

, a11u - Pf . eD ted truth, what one might call 

4. Accord with reality or generally accepted 

the accuracy of the knowledge. 

r i the relative proportions of propositions, , 

5. Variety of types of element, the relative P »~ 

images, and episodes. 

"variety o £ topics, the or diversity o, the person's snowledge. 

,. Shape, a ai«icult dimension to de.ine hut which refers to" the pattern, ., 
and degree o £ association among the elements o £ knowledge. 
8 . Patio o £ internal to external associations, the proportion o £ 
associations which involve concepts that are be ^integral part 

„ntrasted with those that nay be seen as more general or 
of the topic as contrasted wiui ^» . 

mere belonging to another topic. 

Availability, the ease with which knowledge is recalled. 
W. The extent s,or. was taRen as the total number o £ propositions, 
images . and episodes , whether 'accurate or not . 

decision. Kacn proposition was scored as vague or precise. This has to 
reactive, and perhaps sbouid be checked by the degree o £ agreement 
among independent observers. Xn this study, which to .some degree must be 
regarded as a preliminary e ££ ort. we merely discussed any di ££ icult cases 

. . u^-t-alcen to be the fraction 

and made a Joint decision. The precise score was taken 

o£ tne total nunfcer o £ propositions which was accepted as prec.se. 
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X ^ the taction c £ the ^ of conflicts paira o £ propoeitione 

awiaea'hy the tot.! r-,er o £ positions, — ^ * 

*N naarlv everyone scored 1.00 on 
conflicting statements were obeervea.Vso nearly 

• . ' . ; on At. ni g„t not be the X caee with other groups o£ reepondents 
this dimension, anis lingua \ 

or other topics, \ . 

a q correct or not. The 
^^^ealit*. Each proposition was scorers correc 

. texts were thus the Authority for Reality or 
authors, backed by reference texts, were t ^ . 

• a o little difficulty in this as there 
generally accepted truth." There xs as Ixttle *^ty 

factual test. The dimension score -asWated as the 
is in scoring any factual test. \ 

taction which wee ecorea correct o« the total o £ prWione. 

^^^^ The £ ractiona o £ propoeitione. iW.. -no 
epi5 oaee „a k ing op the total extent were caicalatea. Thee thie ^neron 
. „ae repreeentea by three ecoree. Pot «* p.*— that . a, he the ^ 
Wl way o £ representing thie aepect o £ cognitive etrnctere. However,^ 
there - ~. occaeion on which a eingle ~, U — - J. £ , 
... inventea egeal to the reciprocal o £ the ee„ o £ the scares o £ the three 

# , MQ of 3 when there are equal 
fractions. This index takes its maxxmum value of 

— a '.{c^es. and its minimum of-1 when, 

numbers of propositions,, images, and episodes, 

only one type of element is present. 

* nrooerty of the total memory 
• - of romcs This dimension refers to a property « 
Variety of topxes . 

~" «»A in this study where only two topics were 

store, and cannot be assessed xn this stu y 

sampled. 

* i .,c to the view that Whxte'-s 

■ shafe. ^rience gainea in thie steay leaae ue to t 

— , fi. if rai-hpr vaQue , and .tnat 

(19 79) initial postulate of this dimensxon left xt rather 

• * i.rirv of the description of cognitive 

dividing it further may add to the clarxty of 

^4- nroqpnt we identify only a 
structure. Even further work is necessary; at present 

, i • kino The derivation of scores on degree of linking and 
dimension of lxnkxng. The oer 

, nf chaDe takes some space to 
the trend of our thoughts about the rest of shape 

describe. 
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Therein concepts in the first proposition . 

on . sheeCana ... Joinea W Hnes. To, e«a»ple. the proposition Metric 
current is carriea by chargea particUs" yields the concepts current, 
^.rge. una particle, which wouia oe placed as a triangle with a line 
UnKin, each pair. Subsequent propositions yield further concepts ana 
UnUng lines. Any pair of concepts may be Join- by any n„*er of 
aepenain, on how ,any proposition, they are mentionea in tether. Images 
ana episoaes are then aaaea, ana areW by lines to any concepts that 
the y contain or refer to. In this way a map is constructea o, each 
-.esponaenfs cognitive structure, figure 1 is an example. This approach 
i= . relatively simple ».a». of obtaining a spatial representation of 
cognitive structure, but aoes rest on several aebatable assertions. The 
mo .t central assumptions are that an array can represent the true nature of 
ccnitlve structure, ana that using concepts as modes in the array.is a 
vali a way to represent the moae or storage in cognitive structure. M we 
„. not ..tlsfiea with the present notion of shape these assumptions may be 

discarded in future work. 

The pictorial form of these maps is interesting, but so far is not 
amenable to scoring. The numbers of concepts ana lin.s can be usea to 
ob tain an inae, of degree of linking, but the appropriate algorithm rs not 

out to be highly correlatea with fcrtent. which may be a aisaavantage. The 

uii i^jj other aspects of shape 
point is discussed in the Results section below. 

besides degree of linking remain unscored. 

• All of a person's knowledge is 

internal to externa_l^ssoc^atxons . All P 

a wh ole, but it is co^on for it to b e conceived as being divided into 
t - opic s. The concepts which were obtained in evaluating Shape can he. 
clas sed as integral parts of the topic or as externa! to it. Thus batter. 



charge. multimeter, superconductor, electron, shoe*, anode, were ciass.o.py 
us as internal to the topic of electricity, while externals included heat, 
power, ftow. magnets, traffic, pollers, string, steam. This classification 
is. of course, subjective, another way of putting it is that the concepts^ 
"were considered in relation to' their standing in our. the judges', cognitive 
structures. Together we had little trouble in agreeing on each concept's 
place, but confess that the classification is rather arbitrary. 

The numbers of links to each of the two classes of concepts were 
summed. The index calculated is the nu^er of links to Internal concepts . 
divided by the total number of links, so it is a measure of degree of 
internal linking. It was preferred to the ratio of internal to external ' 
links because the distribution of the'latter is .ore likely to be skewed. 
availability , interview, o, this type .ay not. be an effective way of 
measuring availability, as the interviewer's part takes up .ore or less time 
depending on rapport with the respondent. We could have obtained an index 
of availability by dividing the extent score by the number of minutes in 
the interview, but chose not to. 
Results. 

The vectors of scores obtained on the several dimensions for the 

* . «=hown in Table 1, and a matrix of correlations between 

28 respondents are shown in TaDie x, 

' all pairs of dimensions is shown in Table 2. \ 

^st of our interest is in some of the correlations in Table 2. 
This interest is in two parts, one on the correlations among different 
tensions within a topic, and the other on the correlations between the 
scores on the same dimension across topics. 

„.„„„M,,ns betwee- different dimensions. «hite M l"9) argued that 
descriptive di»ensions need not be orthogonal to-be useful.. Kevertheless . 
*if there^re high correlations of one dimension,' such as Extent, with all 
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or several others the descriptive valuj. of the set of dimensions would be jr ^ 
reduced. As it happens, Extent correlates highly only with Degree of 
linking, so the other dimensions do add information to the description of 

cognitive structure.. 

The very high positive correlations between Extent and Degree ' 

of linking constitute a difficulty which if, not resolved in this paper. 
The problem is that while some other algorithm could be applied to the 
, numbers of links and concepts which would yield a smaller or even negative 
Correlation, on theoretical grounds we would expect someone who has their 
knowledge well linked together to recall more of it. Therefore there , 
should be a positive correlation between Extent and Degree of linking. 
Correlations of over 0.8>, however, are too large to be useful. We conclude 
that our present conceptualization of Shape is, unsatisfactory, and that it 
may be profitable to think about it in an entirely different way. 

The high correlations between the Percentages of propositions, 
images, and episodes and the Variety index are a mathematical artefact, 
^ong the" other correlations Precision is strongly related to Accord with 
reality, which is comprehendable , and strangely it is negatively related to 
Percentage of images. Before making anything of the latter relation we 
should like to have it replicated in.a further investigation. No sensible 
pattern can be discerned among the other correlations; their erratic 
nature and generally low values support the belief that each dimension 
other than Degree of linking adds something to the description of cognitive 
structure, 

~ j oss topics. The most interesting finding o £ this study is 

the set of relatively high positive correlations for each dimension across 
the two topics. The 'topics were chosen to be unrelated, and there is no 
-essential Uuirement that so.*one who knows a lot about electricity should 
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know a lot about gun, trees. Yefsuch turns out to be the case. It could 
be, of course, not that considerable knowledge of current goes with 
considerable Knowledge of eucalypts, but that the Extent score on both is 
determined largely by a single trait, the willingness to respond in an 
interview. That remains to be checked. Our impression, from observation 
of the respondent,, is that that alternative explanation is not correct. 
It seems more reasonable to interpret the high positive correlation for 
Extent scores as an outcome of a set to learn, to acquire and store 
information. 

The other set of correlations of interest to us is the one 
containing the percentages of the three types of element. The positive 
values for these imply the existence of a*set to store information in one 
or other form. Respondent 13 in Table 1, for instance, has a remarkable 
propensity to recall episodes in both topics, while Respondent 9 has one 
for images.. This discovery is likely. to be important. 

Despite the subjective nature of the classifying of concepts as 
internal or external, the moderate positive correlation between Percent 
internal connections across topics indicates a further trait which may be 
important in the theory of learning. The correlation is exemplified by 
Respondents 4 and 10, who have relatively low proportions of internal 
connections for both topics. Results obtained by Mayer and Greene (1972) 
suggest that external connections are desirable. 

Further work should investigate what underlies these characteristics 
, of tendency to form external connections and preferences for either \ 

„ r .niendps Thev appear likely to be important in 
propositions, images, or episodes. mey *vv* . 

education. 

Level of Knowledge • • . 

• While opinions, about how reasonable are the levels Of the graduates 
" 'knowledge of the two topics are of no value to theory, they can affect; ' 
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practice. The protocols have two notable features:' great diversity, and a 
lower range reaching an abysmal level of ignorance. For electric current 
"Extent scores range from 29 to 145, and for eucalypts from 13 to 110. The 
observation of such ranges in Extent emphasises the importance of 
considering prior knowledge before teaching new material. Respondent 3's 
Knowledge of electric current and Respondent 27's knowledge of eucalypts 
are remarkably low for people who are certificated successes of our 
educational system. Of course, it could be argued that it is unreasonable 
to expect everyone to know a lot about any one topic chosen from the 
universe of knowledge. ^However, we would have expected science graduates 
to have a greater knowledge of electricity than was shown by at least a 
third of the respondents, and it concerns us that so many have been so . 
untouched by the purpose of science teaching to make people more observant 
that they have never seen flowers on eucalypts and indeed are unsure of 
whether eucalypts do flower. It seems that some of the respondents have 
learned, from 16 years of formal education, to pass examinations but have 
missed other, more crucial parts of an education. 
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ELECTRIC CURRENT 



Extent 
precision 

Accord with reality 
g I propositions 

I iaagcs 
J> I episodes 
■> Variety 
I internal 
Links 
Extent " 
Precision 

Accord with reality 
I propositions 
I images 
I episodes 
w variety 



• 36 



* 

«o. 
u 
o 

8 
< 

.28 
.63 



EUCALYPTS 



•a 



.17 
.14 
.02 



01 


sodes 


V'i? 


a 

■ s 

*> 




Xi 

c 


Lsion 


rd with 


g 




Varie 


% int 


Link* 


o 


Preci 


jveco: 


-.26 


.03 


-.22 


.19 


.71 


0 


.19 


.26 


-.38 


.21 


-.03 


.18 


.44 


.46 


© 


.34 


-.06 


.07 


.10 


.30 


.33 


:?3 


.72 


© 


-•58 


-.62 


-.92 


-.19 


.35 


-.05 


-.17 


-.07 




-.28 


.56 


.26 


-.40 


-.30 


-.13 


^.22 






.55 


-.03 


->.03 


.34 


.32 


.29 








• 16 


-.37 


-.03 


.21 


.11 








; ' 


-•13 


.22 
.5$ 


.15 
.01 


.06 
• 33 



.42 



.3* 

/■ 

• 58 - 



8. 
o 



34 

09. 

12 

16 
26 
49 
19 
03 
28 
04 
.00 



-.39 
-.44 
-.24 
-,17 

-.16 
.21 
-•18 
-.12 
-.53 
-.60 
-.55 
-.51 



.16 
,19 
.30, 
.29 
-.07 

7j 
-.11 

.04 
,01 
.43 
.36 
-.83 
-.06 



> *• 
.36 -.40 
.13 -.20 
•08 -.08 
•35-. 18 
.18 .35 
-.24 -.12 
4$ .23 
•.22 @ 
..04 -.56 

.31 -.48 
-.01 -.24 
-.07 -.24 
-.99 .09 

.57 y^.37 

.78 -.35 
.-.09 



I internal 



.69 

.46 

.40 

.09 
-.44 

.32 
-.18 

.22 

© 

.80 
.23/] 

• 40 
.18 

-.36 

• 02 
r.21 
-.41 



